[FIX] Fix high GPU memory usage#351
Conversation
aliceb-nv
added
non-breaking
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
|
/ok to test a8ebd6a |
|
/ok to test 94d4f96 |
| { | ||
| // Otherwise, we need to get the free memory from the device | ||
| size_t free_mem, total_mem; | ||
| cudaMemGetInfo(&free_mem, &total_mem); |
There was a problem hiding this comment.
In pool memory allocator, we would have probably allocated most of the memory, but the allocator itself might have available memory.
There was a problem hiding this comment.
This is only used to get the total device memory :) free_mem is a placeholder here, only total_mem is used
aliceb-nv
changed the title
|
🔔 Hi @anandhkb, this pull request has had no activity for 7 days. Please update or let us know if it can be closed. Thank you! If this is an "epic" issue, then please add the "epic" label to this issue. |
|
Looks good to me. This patch has been working great for running some MIP instances on my laptop. |
|
Sure @nguidotti, you can go ahead, thanks! |
|
/merge |
closes #349 compute_related_variables was heuristically allocating memory based on A100/H100 with >=40GB of VRAM. This is now automatically adjusted based on the total VRAM of the device A command-line option has also been added to solve_MPS_file to specify device memory allocation limits for ease of testing. Authors: - Alice Boucher (https://github.com/aliceb-nv) - Nicolas L. Guidotti (https://github.com/nguidotti) Approvers: - Nicolas L. Guidotti (https://github.com/nguidotti) URL: #351
closes #349 compute_related_variables was heuristically allocating memory based on A100/H100 with >=40GB of VRAM. This is now automatically adjusted based on the total VRAM of the device A command-line option has also been added to solve_MPS_file to specify device memory allocation limits for ease of testing. Authors: - Alice Boucher (https://github.com/aliceb-nv) - Nicolas L. Guidotti (https://github.com/nguidotti) Approvers: - Nicolas L. Guidotti (https://github.com/nguidotti) URL: #351
5 participants
closes #349
compute_related_variables was heuristically allocating memory based on A100/H100 with >=40GB of VRAM.
This is now automatically adjusted based on the total VRAM of the device
A command-line option has also been added to solve_MPS_file to specify device memory allocation limits for ease of testing.